Search results for " Gestures"
showing 10 items of 23 documents
The facilitative effect of gestures on the neural processing of semantic complexity in a continuous narrative
2019
© 2019 Elsevier Inc. Gestures are elemental components of social communication and aid comprehension of verbal messages; however, little is known about the potential role of gestures in facilitating processing of semantic complexity in an ecologically valid setting. The goal of this study was to investigate whether cognitive load, as indexed by semantic complexity, is modulated by the presentation of gestures accompanying speech. Twenty healthy participants watched 16 video clips of a short narrative while instructed to carefully listen to and watch the narrator while functional magnetic resonance imaging (fMRI) data were acquired. The videos contained passages with and without various co-s…
Implicit visual analysis in handedness recognition.
1998
In the present study, we addressed the problem of whether hand representations, derived from the control of hand gesture, are used in handedness recognition. Pictures of hands and fingers, assuming either common or uncommon postures, were presented to right-handed subjects, who were required to judge their handedness. In agreement with previous results (Parsons, 1987, 1994; Gentilucci, Daprati, & Gangitano, 1998), subjects recognized handedness through mental movement of their own hand in order to match the posture of the presented hand. This was proved by a control experiment of physical matching. The new finding was that presentation of common finger postures affected responses differ…
A musical reading of a contemporary installation and back: mathematical investigations of patterns in Qwalala
2021
Mathematical music theory helps us investigate musical compositions in mathematical terms. Some hints can be extended towards the visual arts. Mathematical approaches can also help formalize a "translation" from the visual domain to the auditory one and vice versa. Thus, a visual artwork can be mathematically investigated, then translated into music. The final, refined musical rendition can be compared to the initial visual idea. Can an artistic idea be preserved through these changes of media? Can a non-trivial pattern be envisaged in an artwork, and then still be identified after the change of medium? Here, we consider a contemporary installation and an ensemble musical piece derived from…
Touch or touchless?:Evaluating usability of interactive displays for persons with autistic spectrum disorders
2019
Interactive public displays have been exploited and studied for engaging interaction in several previous studies. In this context, applications have been focused on supporting learning or entertainment activities, specifically designed for people with special needs. This includes, for example, those with Autism Spectrum Disorders (ASD). In this paper, we present a comparison study aimed at understanding the difference in terms of usability, effectiveness, and enjoyment perceived by users with ASD between two interaction modalities usually supported by interactive displays: touch-based and touchless gestural interaction. We present the outcomes of a within-subject setup involving 8 ASD users…
Facilitating joint attention with salient pointing in interactions involving children with autism spectrum disorder
2016
Children with autism spectrum disorder (ASD) reportedly have difficulties in responding to bids for joint attention, notably in following pointing gestures. Previous studies have predominantly built on structured observation measures and predefined coding categories to measure children’s responsiveness to gestures. However, how these gestures are designed and what detailed interactional work they can accomplish have received less attention. In this paper, we use a multimodal approach to conversation analysis (CA) to investigate how educators design their use of pointing in interactions involving school-aged children with ASD or autistic features. The analysis shows that pointing had specifi…
Diagrammatic Gestures. Cognition, Mathematics, and Semiotics.
2021
here are words having an extraordinary evocative power. This is precisely the case of “Diagram” and “Gesture”. The frst term covers an interconnected network of concepts like “graph”, “schema”, “form”, “model”, “arrow”, and so on... And the same can be said of the second one: just think, for example, of the ideas of “movement”, “bodily action”, “practical activity” or, more generally, of “doing”. Accounting for them has been, over the last 50 years, the aim of signifcant portions of the work conduction in philosophy (Deleuze, Foucault, Merleau-Ponty), mathematics (Grothendieck, Lawvere, Thom), semiotics (Peirce), and theoretical linguistics (Culioli, Langacker, Pottier). The present issue a…
Design and Implementation of Deep Learning Based Contactless Authentication System Using Hand Gestures
2021
Hand gestures based sign language digits have several contactless applications. Applications include communication for impaired people, such as elderly and disabled people, health-care applications, automotive user interfaces, and security and surveillance. This work presents the design and implementation of a complete end-to-end deep learning based edge computing system that can verify a user contactlessly using &lsquo
GESTURES AS A COMMUNICATION FEATURE IN CHILDREN WITH DEVELOPMENTAL LANGUAGE DISORDER
2019
Gestures as non-verbal communication allow us to express our attitude, emotional state, and it functions unconsciously. The verbal communication appears in the life of a child about 2 years of age and gradually replaces the non-verbal communication. However, children with DLD (Developmental Language Disorder) at the age of 3 and more do not speak or speak using separate sounds and combinations of sounds in their speech and use gestures broadly; it helps them to communicate with others. The aim of the article is to explore what kind of gestures as non-verbal communication are used by children with DLD in order to communicate with peers and adults. Based on the scientific literature of the re…
Print and online newspapers as material artefacts
2014
Traditional newspaper journalism is in a state of crisis and there have been several attempts to overcome this. Many discourses have reiterated the triumphal march of a digital revolution in newspaper journalism and anticipated the end of the print newspaper. This moment calls for an in-depth analysis of reader habits of news consumption and use in order to understand the audiences for journalistic output and their relationship with the journalistic objects. In this study, we adopt a multi-method approach, integrating (1) qualitative content analysis of student essays dealing with the physicality of printed and online newspapers, (2) ethnographic observation of the use practices of readers…
Early communicative gestures and play as predictors of language development in children born with and without family risk for dyslexia
2014
The present study investigated early communicative gestures, play, and language skills in children born with family risk for dyslexia (FR) and a control group of children without this inheritable risk at ages 12, 15, 18, and 24 months. Participants were drawn from the Tromsø Longitudinal study of Dyslexia (TLD) which follows children's cognitive and language development from age 12 months through Grade 2 in order to identify early markers of developmental dyslexia. Results showed that symbolic play and parent reported play at age 12 months and communicative gestures at age 15 months explained 61% of the variance in productive language at 24 months in the FR group. These early nonlinguistic …